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1.0  INTRODUCTION 

The  fusion  of  remotely  sensed  data  has  long  been  used  to  derive  more  information  from  a 
given  source.  The  application  of  multiple  sensors  to  the  problems  of  detection,  tracking 
and  identification  offer  numerous  potential  performance  ^nefits  over  traditional  single¬ 
sensor  approachesH'^l.  The  characteristics  of  multi-sensor  systems  that  can  provide 
operational  benefits  to  specific  applications  include  robust  operational  performance, 
extended  spatial  coverage,  extended  temporal  coverage,  increased  confidence,  reduced 
ambiguity,  improved  detection  performance,  enhanced  spatial  resolution,  and  improved 
system  operational  reliability All  of  these  benefits  can  be  realized  by  one  very 
important  factor,  a  high  diinensionality  d^ision  making  capability.  The  measurement 
space  of  a  multi-sensored  system  has  a  very  high  dimensionality  i^ause  of  the  very  fact 
tlkt  it  uses  multiple  sensors.  Therefore,  it  is  essential  that  the  d^ision  module  analyze  a 
high  dimensionality  feature  space  with  dynamic  adaptation  of  changing  environments. 
Such  a  decision  nuidng  system  will  be  extremely  valuable  for  fast,  reliable  performance 
under  complex  circumstances. 

In  response  to  DOD  Army  solicitation  A93-023,  POC  proposed  a  new  type  of  processing 
module  that  is  far  superior  to  any  other  type  of  computing  method.  The  greatest  advantage 
of  POC's  processing  module  is  ^at  it  combines  the  ability  of  a  human  to  adapt  to  changing 
facts  with  the  constant,  uniform  behavior,  predictability,  speed,  large  information  storage 
cr^acity  and  non-emotional  responses  of  machines.  This  proposed  highly  dimensional 
decision  module  is  based  on  the  genetic  algorithm  (GA)  with  the  adaptation  of  fuzzy  rules, 
which  control  the  processes  of  each  generation  more  efficiently  when  compared  to  existing 
conventional  GAs. 

The  GA,  developed  by  Hollandt^l,  studies  the  ad^tive  process  of  natural  biological 
systems  and  develops  artificial  systems  that  mimic  their  adaptive  mechanism.  Recently, 
genetic  algorithms  have  been  successfully  ^plied  to  various  optimization  problems,  such 
as  the  traveling  salesman  problem!^**!,  image  processing!^'*®!,  neural  network  training 
[11-13]^  and  other  search  and  optimization  operations!*'*'*®!.  Genetic  algorithms  differ  from 
traditional  optimization  methods,  in  that  tl»y  combine  the  concept  of  "survival  of  the  fittest" 
among  strong  structures  with  a  structured,  yet  randomized,  information  exchange.  The 
result  is  a  search  algorithm  that  possesses  some  of  the  irmovative  flare  of  human  intuition 
when  applied  to  problem  solving.  In  each  generation  of  the  GA,  a  new  set  of  strings  is 
created  using  bits  and  pieces  of  die  fittest  of  the  previous  generation.  The  advantages  of 
GAs  are  as  follows: 

1 .  Genetic  algorithms  use  a  coding  of  the  parameter  set  rather  than  the 
parameters  themselves. 

2 .  Genetic  algorithms  search  from  a  population  of  search  nodes  instead  of 
from  a  single  one. 

3 .  Genetic  algorithms  use  probabilistic  transition  rules. 

4 .  Genetic  algorithms  use  objective  function  information  instead  of  derivatives 
or  other  auxiliary  knowledge,  which  are  usually  tedious  to  perform. 

A  genetic  algorithm  consists  of  a  string  representation  (“genes”)  of  the  nodes  in  the  search 
space,  a  set  of  genedc  operators  for  generating  new  search  nodes,  a  fitness  function  to 
evaluate  the  search  nodes,  and  a  stochastic  assignment  to  control  the  genetic  operators. 
Here,  each  gene  presents  each  sensor  with  a  level  of  dimension. 

Typically,  a  genetic  algorithm  consists  of  the  following  steps. 
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1 .  Initialization — an  initial  population  of  the  search  nodes  is  randomly 
generated. 

2 .  Kvaluatinn  of  the  fitness  function— the  fitness  value  of  each  node  is 
calculated  according  to  the  fitness  function  (objective  function). 

3 .  Genetic  operations — new  search  nodes  are  generated  randomly  by 
examining  the  fimess  value  of  the  search  no^s  and  applying  the  genetic 
operators  to  the  search  nodes. 

4 .  Repeat  steps  2  and  3  until  the  algorithm  converges. 

From  the  above  description,  it  can  be  seen  that  genetic  algorithms  use  the  notion  of 
"survival  of  the  fittest"  by  passing  “good”  genes  to  the  next  generation  of  strings,  and  by 
combining  different  strings  to  explore  new  search  points.  The  construction  of  a  genetic 
algorithm  for  any  problem  can  be  separated  into  four  distinct,  yet  related  tasks. 

1 .  The  choice  of  the  representation  of  the  strings, 

2 .  The  design  of  the  genetic  operators, 

3 .  The  determination  of  the  fitness  function,  and 

4 .  The  determination  of  the  probabilities  controlling  the  genetic  operators. 

In  this  Phase  I  program,  POC  focused  on  determining  the  above  tasks.  The  results  of  these 
determinations  are  presented  in  Section  3. 


1.1  Hi£h  Dimensionality  Decision  Capability  of  GAs 

The  mechanics  of  GAs  ate  very  simple,  and  involve  generating,  copying  and  swapping 
strings.  Each  string  is  a  binary  representation  of  parameters.  Each  parameter  has  a 
different  dimensional  factor.  For  example,  a  four  dimensional  pattern  representing  a 
chromosome  (string)  consists  of  four  genes^  as  shown  in  Figure  1-1. 


A 

B 

C 

D 

Figure  1-1. 

Control  Parameters  Represented  as  a  Chromosome. 


In  order  to  increase  the  dimensionality,  one  can  simply  increase  the  number  of  genes  in 
each  string,  thus  changing  the  fimess  function.  Therefore,  using  GAs  high  dimensionality 
decision  making  is  very  simple,  when  compared  to  any  other  traditional  optimization 
method.  In  each  gene,  the  number  of  binary  bits  can  be  of  different  lengths.  Thus,  in  the 
case  of  multi-sensor  fusion,  the  number  of  binary  bits  for  each  gene  can  be  chosen 
depending  on  the  resolution  of  each  sensor.  This  flexibility  provides  very  high  adaptability 
to  vatying  environments,  which  is  the  most  important  issue  for  high  dimensionality 
decision  making. 


1.2  Fundamental  Procedure  of  GAs 

Basically,  GAs  are  divided  into  two  main  operations;  random  initialization  and  evolution, 
as  shown  by  the  computer  program  in  Figure  1-2. 
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Random  Initialization:  initialize  ( ); 

evaluate  (); 
select  0 

Evolution  Procedure :  for  ( 1  =0: 1  <M AX-GENERATION S  ;-H-i )  { 

reproduce  (); 
crossover  (); 
mutate  (); 
evaluate  () 

) 

Figure  1-2. 

Two  Main  Genetic  Algorithm  Operations;  Random  Initialization  and  Evolution. 


In  the  initialization  function,  a  population  of  chromosomes  is  created  by  randomly  selecting 
values  for  the  genes.  Each  variable  is  allowed  to  span  its  own  fixed  domain  of  floating 
points  (or  discrete  values);  therefore,  the  chromosome  may  be  composed  of  genes  spanning 
continuous  and/or  discrete  domains.  This  is  permissible,  provided  that  the  gene  locations 
corresponding  to  each  variable  remain  int£u;t.  Next,  each  chromosome  is  evaluated  for  its 
fitness  in  the  evaluation  module.  The  fitness  is  related  to  the  cost  function,  in  that  the  best 
estimates  will  have  the  largest  fitness  values.  Once  the  chromosomes  have  been  assigned 
values,  patent  chromosomes  for  the  next  generation  are  selected. 

In  the  first  step,  the  parent  chromosomes  are  reproduced.  Next,  a  probability  is  assigned  to 
each  chromosome,  according  to  a  fixed  probability  distribution.  Although  this  is  a 
violation  of  the  schema  theorem,  it  circumvents  the  difficulties  associated  with  fimess 
scaling,  and  provides  a  more  general  algorithm  for  arbitrary  cost  function  mappings. 
Finally,  the  selection  process  is  performed  in  pairs  using  a  random  probability  selection 
weighted  by  the  aforementioned  function.  This  ensures  that  copies  of  the  strongest 
chromosomes  are  passed  on  to  the  next  generation.  Once  a  pair  has  been  selected,  it  is 
permitted  to  breed  and  form  a  pair  in  the  new  generation.  In  this  procedure,  there  are  three 
major  evolution  methods:  reproduction,  crossover  and  mutation. 

The  role  of  each  evolution  is  as  follows: 

1 .  Reproduction  copies  chromosomes  from  one  generation  to  the  next  using 
their  relative  fitness  values. 

2.  Crossover  chooses  a  random  location  in  two  chromosomes.  Then,  the 
chromosomes  are  crossed  so  that  the  resulting  pair  contains  material  from 
both  of  the  two  parent  chromosomes. 

3 .  Mutation  flips  the  value  of  a  randomly  selected  bit  or  a  set  of  bits. 

There  are  many  methods  that  can  be  used  to  implement  each  evolution  procedure.  In  this 
program,  POC  determined  and  implemented  the  most  effective  and  fastest  mutation  and 
crossover  algorithm,  which  is  based  on  fuzzy  logic  controller  that  is  suitable  for  high 
dimensionality  decision  making.  Since  in  each  generation  most  of  the  new  breed  of 
chromosomes  are  redundant  and  rebred,  the  fuzzy  logic  controller  is  used  to  reduce  the 
number  of  iterations,  and  thus  overall  optimization  process.  Also,  it  is  a  commonly  held 
misconception  that  crossover  is  the  most  important  function.  In  our  new  discovery, 
however,  it  was  found  that  mutation  is  the  most  important.  In  particular,  when  we  deal 
with  the  Rosenbrock’s  function  (also  known  as  the  banana  function),  mutation  is  an 
essential  step  to  optimize  the  function.  In  Table  1-1,  a  comparison  of  POC’ s  new  adaptive 
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GA  to  Other  GAs  is  shown.  For  this  comparison,  we  used  a  sorting  problem  for  2D 
space,  with  each  dimension  in  the  image  from  0  to  220.  jhis  comparison  was  done  using  a 
66  MHz  IBM  compatible  computer.  Much  higher  performance  can  be  obtained  by  using 
such  powerful  computers  as  Cray-MP  or  Touchstone  Delta.  Even  with  the  more  powe^ 
computers,  however,  the  higher  performance  of  the  FEGA  will  still  be  evident. 


Table  1'1 .  Excitation  Time  for  Different  Sorting  Algorithms 


Algorithm  Type 

Excitation  Time 

Bubble  Sorting 

1.13  X  10®  hours 

CARM  Sorting 

14.4  hours 

Conventional  GA 

2-3  seconds 

POC  FEGA 

0.3  -  0.5  seconds 

2.0  HIGHLIGHTS  OF  PHASE  I  TECHNICAL  OBJECTIVES  AND 

RESULTS 

In  Phase  I  of  this  program,  POC  successfully  demonstrated  a  universal  decision  making 
method  based  on  GAs  and  fiizzy  rules.  The  algorithm  of  this  decision  making  method  can 
be  used  for  multi-sensor  feature  space  data,  high  dimensionality,  and  dynamically  changing 
environments.  In  addition,  the  algorithm  provides  the  capability  to  build  a  nonlinear 
adaptive  system  that  incorporates  many  of  the  properties  of  human  cognitive  methods. 

The  specific  objectives  of  Phase  I  were:  (1)  design  the  parallel  neural  network  evolution 
hardware  (genetic  evolvers);  (2)  simulation  of  such  system  on  a  digital  computer, 

(3)  perform  a  parametric  study  of  speed  and  population  size;  and  (4)  design  the  Phase  n 
prototype.  PC3c  successfully  completed  the  tasks  as  follows: 

1 .  Designed  the  parallel  genetic  algorithm  evolvers, 

2 .  Performed  the  computer  simulation, 

3 .  Determined  the  speed  and  population  size, 

4 .  Developed  the  most  efficient  mutation  method,  and 

5 .  Determined  the  adaptability  of  fuzzy  rules  to  GAs. 

The  multidimensional  (10  dimensions)  function  demonstration  of  the  optimization 
algorithm  in  Phase  I  has  fully  proved  the  feasibility  of  POC’s  high  dimensionality  decision 
making  approach.  In  fact,  the  accuracy  of  this  method  for  the  banana  function  even 
exceeded  our  expectations.  Based  on  these  results,  POC  believes  that  the  high 
dimensionality  decision  module  can  be  fully  implemented  with  existing  optical  or  electronic 
components  in  Phase  11. 

The  key  achievements  which  fully  satisfy  the  Phase  I  objectives  are: 

1 .  The  demonstration  of  high  dimensionality  decision  making.  A  10- 
dimensional  function  with  2^0  dynamic  range  for  each  gene  was 
successfully  obtained. 

2.  The  determination  of  fiizzy  rules.  Using  fuzzy  rules,  unnecessary 
mutations  (for  early  iterations)  and  crossover  (for  later  iterations)  can  be 
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successfully  eliminated.  Therefore,  the  overall  computing  speed  can  be 
increased  by  at  least  one  order  of  magnitude  in  comparison  to  other  GA 
algorithms. 

3 .  The  reevaluation  of  the  mutation.  The  importance  of  the  mutation  is  well- 
defined  in  this  program.  POC  proved  that  a  GA  with  only  reproduction  and 
mutation  can  be  used,  while  a  GA  with  only  reproduction  and  crossover 
caimot  be  used.  Therefore,  in  the  Phase  I  prototype  implementation,  the 
overall  system  architecture  can  be  minimized. 

4 .  The  design  of  the  GA  evolver.  Optical  crossover  and  mutation  evolvers 
were  designed  using  only  spatial  modulators,  prisms,  and  detectors  (see 
Monthly  Report  for  period  8/93-9/93). 

5 .  The  design  of  the  Phase  11  prototype.  A  tentative  Phase  n  prototype  has 
been  designed.  This  design  will  be  optimized  during  the  first  stage  of 
Phase  n  program. 

3.0  PHASE  I  RESULTS 

In  this  Phase  I  program,  POC  focused  on  the  following  three  major  parts:  (1)  Development 
of  practical  GA  evolution  algorithms  (such  as  reproduction,  crossover  and  mutation),  and 
computer  simulation;  (2)  Fuzzy  logic  implementation  and  application  to  GAs;  and 
(3)  Design  of  the  optical/electronic  GA  evolvers.  The  over^  computer  program  structure 
of  the  GA  is  shown  in  Figure  3-1 .  In  the  next  section,  a  more  detailed  description  and 
explanation  is  included. 


Figure  3-1. 

Flow  Chart  of  General  GA. 
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3.1  Description  of  GA  Computer  Simulation 

GAs  are  powerful  search  algorithms  based  on  the  mechanics  of  natural  genetics.  They 
ensure  the  proliferation  of  quality  solutions  while  investigating  new  solutions  via  a 
systematic  information  exchange  that  utilizes  probabilistic  decisions.  It  is  this  combination 
that  enables  GAs  to  exploit  historical  information  to  locate  new  points  in  the  search  space 
with  expected  improved  performance. 

GAs  are  unlike  many  conventional  search  algorithms  in  the  following  ways: 

1 .  GAs  consider  many  points  in  the  search  space  simultaneously,  not  a  single 
point; 

2 .  GAs  work  directly  with  strings  of  characters  representing  the  parameter  set, 
not  the  parameters  themselves; 

3 .  GAs  use  probabilistic  rules  to  guide  their  search,  not  deterministic  rules. 

GAs  consider  many  points  in  the  search  space  simultaneously,  and  therefore  have  a 
reduced  chance  of  converging  to  local  optima.  In  most  conventional  search  techniques,  a 
single  point  is  considered  based  on  some  decision  rule.  These  methods  can  be  dangerous 
in  multimodal  (many  peaked)  search  spaces;  because  they  can  converge  to  local  optima. 
However,  GAs  generate  entire  populations  of  points  (co^d  strings),  test  each  point 
independently,  and  combine  qualities  from  existing  points  to  form  a  new  population 
containing  improved  points.  Aside  from  producing  a  more  global  search,  the  GAs 
simultaneous  consideration  of  many  points  makes  it  highly  adaptable  to  parallel  processors, 
since  the  evaluation  of  each  point  requires  independent  computation. 

GAs  require  the  natural  parameter  set  of  the  problem  to  be  coded  as  a  finite  length  string  of 
characters.  The  parameter  sets  in  this  study,  which  consist  of  an  entire  set  of  fdzzy 
membership  functions  describing  both  condition  and  action  variables,  are  coded  as  strings 
of  '*0”  and  “1”.  For  example,  one  of  the  parameters  considered  in  this  study  is  a  point  that 
defines  the  upper  limit  of  a  particular  trapezoidal  membership  function,  P,  as  shown  in 
Figure  3-2.  Note  that  four  points  are  required  to  completely  defrne  a  single  trapezoidal 
membership  function.  This  parameter  may  easily  be  represented  as  a  binary  string.  Seven 
bits  are  allotted  for  defining  each  of  the  four  points  needed  to  completely  define  each 
trapezoidal  membership  function.  The  choice  of  seven  bits  was  not  arbitrary'  in  the  current 
problem,  seven  bits  allowed  for  adequate  “resolution”  while  preventing  the  problem  from 
becoming  too  large  to  comfortably  handle.  These  seven  bits  are  interpreted  as  a  binary 
number  (000001 1  being  the  binary  number  3).  This  value  is  mapped  linearly  between 
user-determined  minimum  (Pnun)  and  maximum  (Pmax)  values  according  to  the  following 
relation; 


P  =  P. 


nun 


(1) 


where  P  is  the  value  of  the  parameter  being  coded  and  b  is  the  integer  value  represented  by 
an  m  bit  string. 

This  coding  technique  provides  a  convenient  means  of  representing  a  single  parameter:  one 
of  four  points  needed  to  define  a  single  membership  function.  (Four  points  are  needed  to 
represent  each  membership  function  when  trapezoidal  membership  functions  are  used, 
while  only  three  points  are  needed  to  represent  individual  triangular  membership 
functions.)  However,  each  string  must  represent  an  entire  set  of  membership  functions. 
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with  each  membership  function  describing  all  of  the  condition  and  action  variables.  This 
multiple  parameter  coding  can  be  accomplished  by  coding  each  of  the  necessary  parameters 
in  the  manner  described  above  (the  string  lengths  for  individual  parameters  may  vaiy),  and 
by  concatenating  the  bit  strings. 


Figure  3-2. 

Four  points  such  as  the  one  marked  P  must  be  defined  for  each 
trapezoidal  membership  function  describing  both  condition  and  action  variables. 


3.1.1  String  Representation  and  Initial  Population 

This  section  introduces  the  string  representation  used  for  multidimensional  decision  making 
and  presents  a  method  to  generate  an  initial  population. 


3. 1.1.1  String  Representation 

An  important  factor  in  selecting  the  string  representation  for  the  search  nodes  is  that  all  of 
the  search  nodes  in  a  search  space  are  represented,  and  that  the  representation  is  unique.  It 
is  also  desirable,  though  not  necessary,  that  the  strings  be  in  one-to-one  correspondence 
with  the  search  nodes.  That  is,  each  string  corresponds  to  a  legal  search  node  (see  Figure 
3-3).  The  design  of  the  genetic  operator  is  greatly  simphfied  if  the  string  representation  and 
search  spaces  are  in  one-to-one  correspondence.  Consider  here  the  problem  of  finding  a 
representation  for  genetic  algorithms  in  the  problem  of  job  shop  scheduling.  An 
intermediary  encoded  representation  of  the  schedules  and  a  decoder  was  used  that  would 
always  yield  legal  solutions  to  the  problem.  The  representation  is  somewhat  complicated 
and  is  for  a  different  problem. 
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Search  Space  String  Space 


^  Illegal  Springs 


Figure  3-3. 

Mapping  Between  String  Representation  Space  and  Search  Space. 


For  the  multiprocessor  scheduling  probleml^^i,  a  legal  search  node  (a  schedule)  is  one  that 
satisfies  the  following  conditions. 

1 .  The  precedence  relations  among  the  tasks  are  satisfied. 

2 .  Every  task  is  present  and  appears  only  once  in  the  schedule  (completeness 
and  uniqueness). 

The  string  representation  used  in  this  paper  is  based  on  the  schedule  of  tasks  in  each 
individutd  sensor  or  value.  This  representation  eliminates  the  need  to  consider  the 
precedence  relations  between  the  tasks  scheduled  to  different  sensors.  The  precedence 
relations  within  the  sensors,  however,  must  still  be  maintained. 

In  this  Phase  I  program,  a  string  (chromosome)  can  be  accommodated  by  up  to  20  genes 
(20  sensors  or  20-dimensional  functions).  Each  gene,  when  20  genes  are  used,  can  be 
represented  by  up  to  a  20  bit  string.  Therefore,  a  string  can  be  represented  by  up  to  200 
bits.  Figure  3-4  shows  the  string  representation. 


Figure  3-4. 

General  String  Representation  of  20  Genes,  Each  Gene  is  up  to  10-bit. 


It  should  be  stressed  that  each  gene  can  increase  its  resolution.  Fur  example,  the  dynamic 
range  of  a  gene  is  2"  and  its  resolution  is  2"™,  and  the  number  of  bits  in  each  gene  is  n-t-m. 
The  string  representation  of  the  gene  is  shown  in  Figure  3-5. 
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> 

o 

^2 

An+m 

Figure  3-5. 

String  Representation  of  a  Gene  What  Dynamic  Range  is  2"  and  its  Reselection  is  2'^. 


The  value  of  each  allele  is: 


^n+m 


(—] 


x2® 

x2‘ 

x22 


n+m-l 


As  an  example,  a  chromosome  which  consists  of  3  genes,  with  each  gene  having  a 
dynamic  range  of  2^  and  a  resolution  of  2^,  is  represented  as  a  15-bit  string,  as  shown  in 
Figure  3-6. 


Ao 

Ai 

A2 

A3 

A4 

62 

B3 

B4 

Bs 

Ci 

C2 

C3 

C4 

Cs 

Figure  3-6. 

String  representation  of  15-bit  chromosome  which  consists  of  3  Genes,  dynamic  range  of 

each  gene  is  2^  its  resolution  is  2^. 


In  the  case  of  10101  1 1 100  001 1 1,  the  value  of  each  gene  is:  for  gene  A, 

A  =  -I-  +  4-x2'‘  =  5.25, 

22  2^  2^ 


The  first  major  portion  of  our  GA  computer  program  is  shown  in  Figure  3-7  .  This  part  of 
the  computer  program  randomly  generates  decimal  numbers  that  are  in  the  range  of  the 
gene's  dynamic  range.  Here,  chrof  [i]p]  represents  the  decimal  value  of  each  gene  (j**’ 
gene  of  chromosome  i).  Then,  the  decimal  value  of  each  gene  is  converted  into  its 
corresponding  binary  string,  defined  as  bit_val[i][k]. 
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*  This  pare  of  program  is  to  generace  a  number  of  randomly  selected 
initial  genes  */ 

for  (i=l;  i<=intn;  i-*-*) 

{ 

for  (j=l;  j<»ngene;  j++) 

{ 

chrof [i] [j]=0. ; 

) 

} 

for  (i=l;  i<»intn;  !+♦) 

{ 

for  (j=l;  j<=ngenej  j++) 

{ 

int_randsir2U3d( )  ; 

resultsldiv( (long) int_rand,mod( j] ) ; 
chrof 11] [j] “(double )result.rem; 

1 

} 

intm_pxval=0  j 

for  (i=l;  i<aintn;  i++) 

{ 

intm_pxval®0 ; 

for  (j»l;  j<*ngene;  j++) 

{ 

geneval= ( int) chrof [1] [ j ] ; 
for  (t=l;  t<«nbit(j];  t++) 

{ 

)c*intjn_pxval  +  t; 

result=ldiv( (long)geneval. (long) 2) ; 
blt.valti] (kl= (int) result. rem; 
geneval“ ( int ) result . quot ; 
if  (t*-nbit[j]) 

( 

intjn_pxval=intm_pxval+nbit  ( j  ] ; 

} 

) 


) 


} 


Figure  3-7. 

Random  initial  population  generation  subroutine. 


3.1.2  Fitness  Function 

The  fitness  function  in  GAs  is  basically  the  objective  function  that  we  want  to  optimize  in 
the  problem.  It  is  used  to  evaluate  the  search  nodes  and  also  controls  the  generator 
operators.  The  fimess  functions  used  for  this  Phase  I  program  are  based  on  the  maximum 
or  minimum  value  of  the  multidimensional  functions,  and  are  defined  as: 

FT(s)  =  Xii,  X2i.  ...Xni.  f(Xli>  X2i.  -Xm) 
where  /(Xii.  X2i.  -  Xm)  is  the  multidimensional  function. 

In  our  demonstration  computer  simulation,  five  functions  are  selected,  including  a  10- 
dimensional  function  and  a  banana  function,  as  shown  in  Figure  3-8. 
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ririncf 
r rincf 
.srincf 

rincf 
rintf 
.  rincf 
princf 
princf 
-■canf  ( 
princf 


("WHAT  FUNCTION  DO  YOU  WANT  TO  CHOOSE? \n'); 


•\n(l) 

■\n<21 

'\n(3) 

'\n(4) 


Fl{x,y)  =  a*  (x^'b  -  d)  *  (y^c  -  f)  +  g;\n“); 

F2(x,y)  =  (x-2''cl‘'d  +  (y-2''g)"'h  -  2'‘o\n“); 

F3 (xl.x2.x3.x4)  =  a»xl*x2*x3  -  b*x2*x3 *x4\n“ ) ; 

F4(xl . xlO)  =  xl*x2  -  x3*x4  +  x5*x6  -  x7*x8  +  x9*xl0  \n" ) ; 

-  xl*x5*x9\n") ; 

Banzma  fimccion  F5(xl,  x2)  =  562500.  - 
9.*  xl*xl*xl*xl  -  750.  •  xl*xl  *  x2  +  15625 
\nTYPE  1.  2.  3,  4  or  5\n“ ) ; 

"%d“,  Sichoice)  ; 

("choice  =  %d\n“  ,  choice); 


( 

( 

( 

(" 

(“\n(5) 
( 

( 


22500.  *  xl  +  225. 
.  *  x2*x2;  \n"); 


xl*xl  +  \n“ 


Figure  3-8. 

List  of  the  five  fitness  functions. 


3.2  Genetic  Evolvers 

GAs  are  composed  of  three  operators;  reproduction,  crossover  and  mutation.  These 
operators  are  implemented  by  performing  the  basic  tasks  of  copying  strings  (reproduction), 
exchanging  portions  of  strings  (crossover),  and  by  reversing  the  v^ ue  of  the  strings,  from 
0  to  1  or  visa  versa  (mutation).  For  the  sake  of  simplicity,  we  chose  two  parent 
chromosomes  with  3  genes  for  each  chromosome  (see  Figure  3-9): 


1 

_Q_ 

1 

Uj 

0 

1 

UJ 

1 

_Q_ 

0 

P1 


Gene  1 


Gene  2 


Gene  3 


0 

1 

rri 

1 

1 

s 

□ 

1 

9 

1 

P2 


Figure  3-9 

Illustration  of  Two  Parent  Chromosomes  Representing  3  Genes. 


3.2.1  Reproduction 

Reproduction  is  a  process  in  which  individual  strings  are  copied  according  to  their  objective 
function  values  (see  Figure  3-10).  The  reproduction  operator  may  be  implemented  in 
algorithmic  form  in  a  number  of  ways.  POC  first  selected  two  maximum  and  minimum 
fitness  chromosomes  as  parents  from  the  previous  interaction,  and  then  reproduced  these 
maximum  and  minimum  fimess  chromosomes.  The  subroutine  of  the  reproduction  was 
shown  in  Figure  3-11.  In  this  program,  maxparent  [j]  is  the  maximum  fimess  chromosome 
from  the  previous  iteration,  while  minparent  [j]  is  the  minimum  fimess  chromosome.  The 
maxparent  2  |j]  and  the  minparent  2  (j)  are  second  maximum  and  minimum  fimess 
chromosomes,  respectively.  Therefore,  the  result  of  reproduction  of  pi  and  p2  is 
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Figure  3-10 

Two  reproduced  chromosomes  from  the  parents 


void  reproduction (void) 

( 

/*  This  part  of  program  is  to  perform  the  reproduction  of  the  maximum 
fitness  chromesome  */ 
nb=l; 
nea4  ; 
neold=0; 
nboldsO ; 

for  {j=l;  j<=slength;  j++) 

( 

bit_val[l] [j]amaxparent{ j] ; 
bi t_val [ 2 ] ( j ] smaxparent2 [ j ] ; 
bi t_val 13] [ j ] smlnparent  ( j ] ; 
bit_val ( 4 ] [ j ] »minparent2 1  j ] ; 

) 

/*  fprintf(fl,  “ - reproduction - \n"); 

for  (i  =  nb;  i  «*  nej  i++) 

{ 

fprintftfi,  "i  =  %d  i); 
for  (j  =  1;  j  <=  slength;  j++) 

t 

brintf  {fi,  "%d-,bit_vairi]  tj]); 
if  (jnslength)  fprintfCfi,  "\n"); 

) 

) 

printf("The  reproduction  is  f inishedXn* ) ; */ 
nbrep  =  nb; 
nerep  =  ne; 
nbold=nb; 
neold^ne; 


) 


Figure  3-1 1 

The  subroutine  of  reproduction  program. 


3.2.2  Crossover 

Crossover  exchanges  information  via  probabilistic  decisions,  and  provides  a  mechanisrn 
for  strings  to  mix  and  match  their  desirable  quaUues  through  a  random  process.  B^icaUy, 
there  are  two  types  of  crossover:  inter-gene  crossover  and  outer-gene  crossover.  Inter- 
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gene  crossover  performs  information  exchange  within  the  same  gene,  while  outer-gene 
performs  information  exchange  between  different  genes.  For  example,  inter-gene 
crossover  for  gene  2  is  illustrated  in  Figure 


3-12. 


( 1)  Select  a  position  of  strings  from  each  parent  (as  shown  in  Figure  3-12). 


Selected  Alleles 


Selected  Alleles 


Figure  3-12 

Selection  of  String  Position 


(2)  Exchange  the  portions  of  strings  to  the  other  parent  (the  results  of  inter-gene 
crossover  are  shown  in  Figure  3-13). 


Chromosome  1 


Chromosome  2 


1 

1 

1 

1 

1 

sl 

1 

1 

1 

LqJ 

1 

-IL 

_iL 

1 

_iL 

1 

1 

_£L 

□ 

Figure  3-13 

Exchange  of  String  Portions 


In  the  case  of  outer-gene  crossover,  the  procedure  is  as  follows: 

(1)  Select  a  portion  of  strings  from  any  gene,  as  shown  in  Figure  3- 14  (shaded 
parts) 
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Selected  Alleles  Selected  Alleles 


Figure  3-14 

Select  Portion  of  Strings 


(2)  Exchange  the  portions  of  strings.  The  result  of  outer-gene  crossover  is 
shown  in  Figure  3-15. 


Chromosome  3 


Chromosome  4 


G1 

1  1 

1 

1 

0 

1 

Lqj 

LqJ 

_qJ 

Ll 

Lq_ 

U] 

□J 

I  1 

1  0 

0 

1  1  I 

1  1  I 

0 

I  1 

1 

_Q_ 

1 

a 

Figure  3-15 

Result  of  Outer-Gene  Crossover 


The  actual  number  of  crossover  methods  are  numerous,  and  it  is  still  not  clear  which  is  the 
best  crossover  operation.  In  this  Phase  I  program,  P(X!  learned  that  the  early  stages  of  the 
iteration  outer-crossover  speeds  the  convergence  to  optimization;  while  inter-crossover 
speeds  the  late  stages  of  the  iteration.  In  Figures  3- 16(a)  and  3- 16(b),  the  inter-crossover 
and  outer-crossover  subroutines  are  shown. 
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void  crossoveri (void) 

{ 

int  )c.  beg.  p,  q.  pp; 
div_t  result; 

for  (pp  ■  1;  pp<10;  pp*+( 

( 

result  3  dlv(rand(),  cross); 
q  ■  result. reo  +  1; 

result  =  div(rand(),  slength  -  q  -  1); 
p  >  result. reiB  *  1; 

nb  m  neold-t-l; 
i  >  nb; 

/*  CROSSOVER  OF  MAX  and  MAX2  •/ 

for  (beg  ■  l;  beg  <«  slength  -  q  1;  beg'<-t-){ 

It  •  p; 

for  (  j  «  1;  j  <■  slength;  j*-*-) 

if  (  j  <  beg  | |  j  >■  beg  +  q) 

bit_val(il (jl  =  maxparent t j  1  ; 

else{ 

bit_valtiHjl  =  maxparent2I)cl  ; 

)t+-»; 

) 

i++; 

)t  «  beg; 

for  (  J  =  1;  j  <•  slength:  j**) 
if  (  j  <  P  1 1  j  >■  P  ♦ 

bit_val  1 1 )  [  j )  =  taaxparentZ  t  j  J  ; 
else( 

bit_valli]  [j]  =  meutparentDc) ; 

It^*; 

) 

i*+! 

) 

ne  s  i  ; 

neold  >  ne; 
nbold  >  nb; 

/•  CROSSOVER  OF  MIN  and  MIN2  */ 

for  (beg  »  1;  beg  <=  slength  -  q  ♦  1;  beg++) { 
)t  ■  p; 

for  (  j  =  1;  j  <=  slength;  j**) 
if  (  j  <  beg  i  1  j  >*  beg  ♦  q) 

bit_val [ 1 ) ( j ]  =  minparent 1 j  1  ; 


Figure  3-16  (a) 

Inter-Crossover  Subroutine  Program 
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elsai 

bit-Val  (il  I  j  )  =  minparent2  [Icl  ; 

: 

} 

)(  ■  beg; 

for  (  j  =1;  j  <a  slengch;  j++) 

(  3  <  P  I  I  j  >■  p  +  q) 
bit_val t i 1 ( j ]  =  minparent2 [ j  1  ; 
el8e{ 

bit_val(i3 ( j]  >  minparentCkl ; 
k++; 

} 

) 

ne  >  1; 

naold  a  ne; 
nbold  ■  nb; 


Figure  3-16  (a) 

Inter-Crossover  Subroutine  Program  (continued) 
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void  crossover (void) 

{ 

noanRoid+l 

n«>n*old+80; 

nbeross  >  nb; 

tor  ll>nb;  i<ane;  i=i*2l 

( 

itt_rand«rand ( 1 ; 
rasulc2>dlvllct_rand. cross) ; 
n>rssulc2 .  rest'*-! ; 

!.nc_remd>retnd  ( ) : 

resulc>Idiv( (long) inr._r and. llong)slengrh-n-l) ; 
p*  ( Int )  result .  reoi'f  1 
tor  {j  ■  0;  j  <  Icol;  j**) 
it  Ip  »  beg(l] ) ( 

it  (Ip  *  cbit(ll)  >  slength) 
p  cbitCj]; 

else 

p  cblt{  j] ; 

) 

for  (j*l;  j<»8length;  j+»> 

( 

it  (p  <«  j  tt  j  <  p4-n) 

( 

bit_val (i] I j ] »maxparent ( j ] ; 
blt_val ( i>l ) [ j ] >maxparenc2 ( j ] ; 

1 

else 

{ 

bit_val(i] tj]>maxparenc2[j] ; 
bit.valji-t-l]  [j]>inaxparenc(ji  ; 

) 

) 

) 

nboldanb; 
a«oLd<-n«: 
nb«neold-i-l; 
ne«neold>100 ; 

for  (Isnb;  i<an«;  i>i4-2) 

{ 

ict.randarajodC )  ; 
result2adlv(lct_rand. cross) ; 
nsresult2 .  rem-t-l ; 
int_rand=rand ( ) ; 

resulcsldivl (long) int_rand.  Hong) (slengch-n-i ) ) 

p*  < int ) result . rem+l ; 

for  (j=l;  j<»slength;  j**) 

( 

if  (p  <=  j  tfc  j  <  p*n) 

( 

blt_val ( i ) I j ] =minparent ( j ] ; 
bit  vald^-i)  [j]sininparent2[  j]  ; 

) 

else 

{ 

bit_val (11 [ j ) =minparenc2 ( j ] ; 
bit_val{i+l] ( j ] sminparent ( j 1 ; 

/ 

} 

} 

nboid^nb; 
neoid>ne; 
n«cros8  s  ne; 


Figure  3-16  (b). 

Outer-Crossover  Subroutine  Program 
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3.2.3  Mutation 


Mutation  can  be  considered  as  an  occasional  random  allocation  of  the  values  of  a  string. 
Until  now,  mutation  was  considered  to  have  a  secondary  role  in  GAs.  However,  PCXT 
found  that  mutation  is  the  most  important  genetic  operator  among  them.  To  prove  this, 
POC  demonstrated  searching  the  minimum  values  of  the  banana  function, 
f(x,y)  =  562500  -  22500x  +  225x2  +  9x^  -  750x2y  +  15625y2,  using  only 
reproduction  and  crossover,  and  also  using  only  reproduction  and  mutation.  In  the  case  of 
the  former,  the  anticipated  result  (0)  could  not  be  obtained  after  300  iterations.  In  the  latter 
case,  POC  successfully  obtained  the  correct  minimum  value  after  only  13  iterations.  This 
provided  the  most  valuable  information  for  desi^ng  the  Phase  I  prototype.  In  this  case, 
the  high  dimensionality  decision  module  can  be  implemented  using  a  simple  architecture. 


As  with  crossover,  there  are  a  number  of  ways  to  implement  mutations.  In  this  Phase  I 
program,  POC  selected  three  essential  mutation  methods; 


(1)  Single-bit  mutation;  Cover  only  1  bit  from  0  to  1  or  visa  versa 


PI  =>  011010110 

Cl  =>  111010110 

C6  =>  01101  1110 

C2  =>  001010110 

C7  =>  011010010 

C3  =>  010010110 

C8  =>  01101  oloo 

C4  =>  011110110 

C9  =>  011010111 

C5  =>  01 100  01 10 

Single-gene  mutation;  This  method  is  to  mutate  a  gene  from  a  single  bit  to 

entire  bit. 

PI  =>  011010110 

C5  =>  111010110 

Cl  =>  01101  1110 

C6  =>  ioioioiio 

C2  =>  011011010 

C7  =>  1^10110 

C3  =>  01101  1000 

C8  =>  10011  0110 

C4  =>  01101  1001 

C9  =>  10010  01 10 

3 .  Combination  of  ( 1 )  and  (2);  In  this  method,  POC  combine  the  method  of 

(1)  and  (2)  that  say,  PI  is  the  chromosome  of  3  genes. 


PI;  oil  010  no 

genet  gene2  gene3 

In  this  case,  we  perform  the  operation  of  (2)  for  gene  3  while  perform  the 
operation  of  (1)  for  gene  1  and  gene  2. 


Cl  =>11 1110^ 


010 

000 

001 


C2=>111000^ 


010 

000 


[001 
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C3=>1I101H 


fOlO 

000 

001 


By  combining  methods  (1),  (2),  and  (3),  the  speed  of  the  convergence  of  the  mutation  can 
be  dramatically  increased  and  no  crossover  is  needed  to  perform  the  desired  optimization. 
Therefore,  the  overall  system  architecture  can  be  extremely  simplified  and  fabricated  using 
existing  components. 


3.3  Fuzzy  Logic  and  Its  Adaptability  to  GAs 

The  Genetic  Algorithm  (GA)  is  a  new  approach  to  the  optimizing  and  searching  method. 
Mostly,  the  residts  of  GAs  are  not  the  optimal  solution  after  many  iterations,  but  only  an 
approximation.  During  the  iterations,  the  major  concern  is  how  to  select  the  right  time  to 
reproduce,  mutate  and  crossover.  Furthermore,  which  allele(s)  need  to  evolve.  During 
this  Phase  I  program,  POC  investigated  the  matrix  manipulation  of  the  GA  algorithm.  In 
order  to  maximize  the  GA  algorithm  PCXI!  also  investigated  the  adaptability  of  fuzzy  logic 
to  this  approach.  Since  each  iteration  requires  three  evolution  methods,  it  was  necessary  to 
determine  which  method  is  the  most  effective  for  a  particular  iteration. 

Fuzzy  logic  is  based  on  the  uncertainty  of  the  fuzzy  set  theory!**'*^!.  The  fuzzy  set  theory 
works  with  the  quantification  of  the  meanings  of  words  in  graphs  within  the  framework  of 
set  theory.  Fuz:^  theory  is  a  mathematical  ^eory,  and  what  is  called  fuzziness  takes  in  one 
aspect  of  uncertainty.  Fuzziness  is  the  ambiguity  that  can  be  found  in  the  definition  of  a 
concept  or  the  meaning  of  a  word.  For  example,  if  we  say  "tall  person",  we  cannot  clearly 
determine  who  is  tall  and  who  is  not.  If  we  t^  a  look  at  the  ambiguity  of  the  meaning  of 
"tall"  in  terms  of  the  expression  of  amount  with  a  range  of  height  of  5'  to  6.5',  the  degree  to 
which  height  x  can  be  called  "tall"  is  that  is,  we  make  the  height  x  correspond  to  degree 
p,,  as  shown  in  Figure  3-19. 


Figure  3-17. 
Grade  of  Height. 
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Therefore,  we  can  obtain  many  outputs;  0  <  p  <  1 .  In  conventional  logic,  the  output  is 
either  "O"  or  "  1 The  main  concern  of  PCXT's  fuzzy  logic  adaptability  to  GA  was  how  to 
utilize  these  many  outputs.  Since  the  GA  is  based  on  the  iteration  of  a  fimess  comparison 
and  an  evolution  operation,  we  used  this  fiizzy  theory  to  reduce  the  number  of  iterations. 

In  our  investigations,  we  found  that  fuzzy  rules  can  make  decisions  regarding  which 
evolution  step  is  more  efficient  to  the  particular  iteration.  For  example,  first  n  maximum 
fimess  chromosomes  are  very  close  to  each  other;  thus,  it  is  better  to  perform  mutation  than 
crossover.  On  the  other  hand,  if  two  high  fitness  alleles  are  not  similar  to  each  other, 
crossover  provides  a  faster  optimum  search  than  mutation.  In  Table  3-1 ,  the  fuzzy  rules 
for  each  necessary  evolutionary  step  are  shown.  These  rules  are  determined  by  the  two 
fuzzy  logic  parameters  Pi  and  qi,  where  Pi  and  qi  are  defined  as  follows: 

p  _  Fimess  of  i**^  Parent -Fimess  of  (i-1)^  Parent 
^  Fimess  of  if*' Parent 


Number  of  identical  bits  between  two  parents 
Number  of  bits  of  chromosome 


Table  3-1.  Fuzzy  Rule  to  Control  Genetic  Operations 


0<Pj<  threshold 

threshold  <  p^  <  1 

0  ^  qj<  threshold 

Reproduction 

100%  Crossover 

Reproduction 

80%  Crossover 

20%  Mutation 

threshold  <  qj  <  1 

Reproduction 

50%  Crossover 

50%  Mutation 

Reproduction 

100%  Mutation 

Fuzzy  logic  control  has  been  successfully  used  in  an  increasing  number  of  application 
areas,  including  task  scheduling,  robot  arm  manipulation,  cement  kiln  control,  railroad 
control,  and  pipeline  control.  Tliese  rule-based  systems  incorporate  fuzzy  linguistic 
variables  into  their  rule  set  in  order  to  model  a  human's  "rule-of-thumb"  approach  to 
problem  solving.  As  an  example,  "If  two  maximum  chromosomes  are  very  much  similar 
based  on  a  bit-wise  comparison,  perform  more  mutations  than  crossover ". 

GAs  are  powerful  search  algorithms  based  on  the  mechanics  of  natural  genetics.  They 
ensure  the  proliferation  of  equal  solutions  while  investigating  new  solutions  via  a 
systematic  information  exchange  utilizing  probabilistic  decisions.  This  probabilistic 
decision  performs  three  basic  evolution  operations;  reproduction,  mutation,  and  crossover. 
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The  main  question  here  is:  "What  is  the  best  evolution  operation  for  each  interaction  ?"  This 
basic  question  leads  to  three  specific  questions: 

1 .  How  many  chromosomes  from  the  previous  population  need  to  be 
reproduced? 

2.  >^ch  locus  (string  position)  needs  to  be  mutated? 

3 .  What  is  the  best  crossover  membership? 

These  questions  can  be  answered  using  fuzzy  logic  control.  Figure  3- 1 8  shows  a 
schematic  of  the  basic  design  of  an  adaptive  genetic  algorithm  based  on  a  fuzzy  logic 
controller. 


Figure  3-18. 

Schematic  Diagram  of  Fuzzy  Logic  Controlled  GA  Processor. 


Reproduction  is  simply  a  process  by  which  strings  with  large  fitness  values  (good 
solutions  to  the  problem  at  hand)  receive  correspondingly  large  numbers  of  copies  in  the 
new  population.  In  tournament  selection,  pairs  of  strings  compete  with  each  other  on  a 
head-to-head  basis  for  the  right  to  be  reproduced  in  the  next  generation.  The  participants  in 
these  competitions  are  selected  based  on  the  relative  flmess  of  the  strings,  manifesting  a 
"survival-of-the-fittest"  atmosphere.  The  fimess  values  of  two  strings  that  are  adjacent  in 
the  popul^on  (adjacent  positions  which  are  determined  randomly)  are  compared.  The 
string  with  the  "best"  fitness  value  is  then  selected.  An  advantage  of  tournament  selection 
is  that  "best"  can  be  defined  as  "highest"  for  a  maximization  problem,  or  as  "lowest"  for  a 
minimization  problem.  Thus,  tournament  selection  yields  a  linear  rank-based  selection. 
Actually,  the  particulars  of  the  reproduction  scheme  are  not  critical  to  the  performance  of 
the  GA;  virtually  any  reproduction  scheme  that  biases  the  population  toward  the  fitter 
strings  works  well.  Once  the  strings  are  reproduced,  or  copied  for  possible  use  in  the  next 
generation,  they  are  placed  in  a  mating  pool  where  they  await  the  action  of  the  other  two 
operators. 
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Strings  exchange  information  via  probabilistic  decisions  by  the  second  operator,  called 
crossover.  Crossover  provides  a  mechanism  for  strings  to  mix  and  match  their  desirable 
qualities  through  a  random  process.  After  reproduction,  simple  crossover  proceeds  in  three 
steps.  First,  two  newly  reproduced  strings  are  selected  from  the  mating  pool.  Second,  a 
uniform  position  aiong  the  two  strings  is  selected  at  random.  This  is  illustrated  below, 
where  two  binary  coded  strings,  A  and  B,  of  length  16  are  shown  aligned  for  crossover: 

A=lllllllll/lllllll 

B=000000000/00QQQ00. 

Notice  how  crossing  site  9  has  been  selected  in  this  particular  example  through  random 
choice,  although  any  of  the  other  14  positions  were  just  as  likely  to  have  been  selected. 

The  third  step  is  to  exchange  all  characters  following  the  crossing  site.  The  two  new 
strings  following  this  crossing  are  shown  below  as  A'  and  B  : 

A'=l  111111 11/0000000 

5=000000000/1  mil  i . 

String  A  is  made  up  of  the  first  part  of  string  A  and  the  tail  of  string  5.  Likewise, 
string  5'  is  made  up  of  the  first  part  of  string  B  and  the  tail  of  string  A.  Although 
crossover  uses  random  choice,  it  should  not  be  thought  of  as  a  random  walk  through 
the  search  space.  When  combined  with  reproduction,  it  is  an  effective  means  of 
exchanging  information  and  combining  portions  of  high-quality  solutions. 

Reproduction  and  crossover  give  GA's  the  majority  of  their  search  power.  The  third 
operator,  mutation,  enhances  the  ability  of  the  GA  to  find  near-optimal  solutions. 

Mutation  is  the  occasional  alteration  of  a  value  at  a  particular  string  position.  It  is  an 
insurance  policy  against  the  permanent  loss  of  any  simple  bit.  A  generation  may  be 
created  that  is  void  of  a  particular  character  at  a  given  string  position.  For  example,  a 
generation  may  exist  that  does  not  have  a  1  in  the  third  string  position  when,  due  to  the 
chosen  coding,  a  1  at  the  third  position  may  be  critical  to  obtaining  a  quality  solution. 

Under  these  conditions,  neither  reproduction  nor  crossover  will  ever  produce  a  1  in  this 
third  position  in  subsequent  generations. 

In  this  Phase  I  program,  POC  showed  the  feasibility  of  applying  fuzzy  logic  to  GAs. 

The  anticipated  benefits  from  the  application  of  fuz^  logic  to  GAs  are: 

( 1 )  Efficient  usage  of  parallel  processor, 

(2)  Entire  or  partial  elimination  of  redundant  evolving  procedure, 

(3)  Reduction  of  system  complexity  and  architecture, 

(.4)  Reduction  of  the  required  interconnectivity, 

(5)  Increase  in  overall  processing  speed,  and 

(6)  An  adaptive  learning  and  processing  capability. 


3.4  Design  of  a  Parallel  Genetic  Evolution  System 

The  terms  GA  and  neural  network  refer  to  classes  of  procedures  and  models  that  are 
developed  as  abstractions  of  information  processing  systems  in  nature.  One  of  the  reasons 
for  these  common  biological  foundations  is  that  the  natural  evolutionary  process  has  highly 
optimized  computational  engines.  Such  an  optimized  computational  capability  can  be 
obtained  through  a  parallel  processing  computing  system.  Since  each  GA  system  operates 
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on  a  population  of  individuals,  a  parallel  computing  approach  is  of  great  importance  in 
speeding  up  the  algorithm’s  execution.  An  initial  design  of  a  processing  platform, 
including  a  multiple  instmction/multiple  data  (MIMD)  architecture  based  on  a  digital  signal 
processor  (DSP)  computing  environment,  has  been  completed  in  this  Phase  I  program. 
The  flow  chart  for  a  parallel  electronic  genetic  evolution  system  (PEGES)  on  a  pai^el 
processor  architecture  is  shown  in  Figure  3-19.  This  process  can  be  greatly  accelerated 
through  the  use  of  a  multiprocessor  structure  with  high  interconnectivity. 
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3.4.1  Initial  Design  of  DSP  Parallel  Processor 

POC  has  good  experience  in  the  design  of  electronic  multiprocessor  systems.  Based  on 
this  in-house  experience,  POC  will  fmalize  the  Phase  11  prototype  design  in  the  early  stages 
of  the  Phase  n  program.  In  this  section,  a  description  of  a  multiprocessor  system 
previously  developed  at  POC  is  presented.  In  the  Phase  n  project,  POC  will  increase  the 
number  of  DSP  processors  and  develop  a  more  flexible  optoelectronic  interconnection 
network. 

The  processing  power  of  POC's  multiprocessor  system  is  based  on  the  Texas  Instruments 
DSP  chip  (TMS320C40).  Three  processing  layers  (PLs)  containing  processing  elements 
(PEs)  are  proposed  in  a  3-D  configuration.  Each  layer  contains  4  PEs,  and  each  PE  can 
communicate  by  a  bi-directional  link  with  a  host  computer.  The  communication  between 
the  host  computer  and  the  PEs  uses  a  direct  memory  access  (DMA)  mode  for  fast  data 
transfer.  Each  PE  can  access  its  local  memory  and  a  part  of  the  global  memory.  The  host 
computer  can  access  the  global  memory  only.  The  d^  exchange  between  the  host 
computer  and  the  PEs  is  obtained  by  updating  the  global  memory  addressable  by  the  host 
computer.  A  conceptual  graph  showing  the  data  transfer  between  the  host  computer  and 
the  PEs  is  depicted  in  Figure  3-20.  TTie  data  transfer  from  the  host  computer  to  the  PEs 
can  be  performed  sequentially  if  each  processor  needs  to  receive  a  different  set  of  data  or 
can  be  broadcast  in  parallel  if  an  identical  data  set  is  to  be  processed  by  each  PE. 

The  developed  multiprocessor  system  contains  four  DSP  processors  per  layer.  A  total  of 
three  layers  have  been  fabricated.  Figure  3-21  shows  a  three-layer  parallel  multiprocessor. 
Each  layer  consists  of  an  array  of  no^s.  Each  node  contain  one  PE  and  one  optical 
interconnect  (OD  module.  The  optical  interconnects  are  designed  to  be  unidirectional  for 
feed-forward  data  transfer.  Figure  3-22  illustrates  the  design  of  each  layer.  Two 
communication  schemes  are  used.  A  parallel  fully  interconnected  network  for  four  PEs 
(per  layer)  is  employed  in  the  node  array  to  efficiently  handle  2-D  transfer  of  data  to/from 
the  host  computer.  This  system  bus  solves  the  data  transfer  bottleneck  between  the  host 
computer  and  the  multi-processor  system  Due  to  this  system  bus  design,  the  node  in  the 
multiprocessor  system  will  not  be  inteirupted  and  can  continue  to  process  data  and 
simultaneously  transfer  data  to/from  the  host  computer.  An  additional  RAM  in  each  node 
will  make  this  uninterrupted  data  transfer  possible.  The  second  interconnection  system  is 
used  to  provide  vertical  point-to-point  communication  between  two  layers  of  PEs.  One  of 
our  main  goals  in  this  Phase  II  program  is  to  improve  the  existing  optical  inter-layer 
conununication  (i.e.,  vertical  communication)  by  employing  a  faster  and  reconflgurable 
many-to  many  interconnection  scheme. 
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LD  (Mounted  on  the  Other 
Side  of  the  Board) 


To/From  PC  (Address  and  Data  Buses) 


Figure  3-22. 

Interconnection  scheme  for  a  single  layer. 
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3.4.2  Mapping  GA  to  Parallel  Processor 

Assume  that  we  want  to  process  one  frame  of  an  image  as  a  chromosome.  In  this  case,  it  is 
essential  to  achieve  high  interconnectivity  as  well  as  a  high  processing  speed.  Here,  it  is 
impossible  to  process  such  a  large  number  of  strings  using  a  single  processor.  On  the 
other  hand,  a  multiprocessor  with  high  interconnectivity  (as  described  in  the  previous 
section)  can  be  applied  to  image  understanding  issues.  Unfortunately,  there  is  one 
drawback  to  this,  which  is  the  mapping  of  the  GA  to  parallel  processing.  This  is  available 
with  the  3L  parallel  C  programming  language,  which  implements  the  same  parallel 
processing  model.  Parcel  C  implements  the  modules  of  a  block  diagram  as  independent 
tasks  that  communicate  via  unidirectional  channels. 

Parallel  C  is  a  software  environment  for  programming  in  multi-processor  systems.  It  is 
specifically  desired  to  implement  the  modular  architecture  of  parallel  networks,  such  as 
the  DSP  block  diagram  method  of  specifying  algorithms.  It  is  based  on  a  model  from 
parallel  processing  theory  known  as  Communicating  Sequential  Processes  (CSP).  In  this 
model,  a  computing  system  is  a  collection  of  concurrently  active  processes  (or  tasks), 
which  can  only  communicate  with  each  other  over  channels,  as  in  Figure  3-23.  A  channel 
connects  exactly  one  processor  to  exactly  one  other  processor.  Channels  are  unidirectional; 
two  are  required  for  communication  in  both  directions.  Each  processor  can  have  any 
number  of  channels.  Channels  are  automatically  synchronized;  a  sending  processor  must 
wait  until  the  receiving  processor  is  ready.  Here  a  processor  is  treated  as  a  “black  box” 
connected  to  the  outside  world  only  by  its  channels.  What  is  inside  is  not  important;  it 
could  be  another  complex  system  of  software  or  hardware. 


With  Parallel  C,  an  application  comprises  a  number  of  these  sequential  tasks  which 
communicate  by  means  of  unidirectional  channels.  These  tasks  are  programs  that  execute 
standard  C  code,  assembler,  or  DSP  library  function  calls,  and  have  their  own  region  of 
memory  for  code  and  data.  Each  task  has  vectors  of  input  ports  and  output  ports-,  tasks 
can  communicate  with  each  other  by  arranging  for  the  output  pon  of  one  task  to  be 
connected  to  the  input  port  of  another  task.  Tasks  can  be  treated  as  building  blocks  for 
parallel  systems,  to  be  wired  together  rather  like  electronic  components.  In  addition  to  the 
static  tasiu,  there  is  also  the  facility  to  create  light-weight  tasks  called  threads  dynamically 
at  run-time. 

A  configurer  controls  the  placement  of  tasks  and  channels  onto  the  available  processor 
network.  Two  configuration  tools  are  available.  The  General  Configurer  takes 
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information  about  both  the  logical  and  physical  topology  of  the  DSP  network  and  combines 
multiple  tasks  into  an  application  image  suitable  for  execution.  Assigmnent  of  tasks  to 
processors  is  determined  by  a  user-written  text  file  called  a  configuration  file.  Changing 
the  configuration  only  required  re-running  the  configurer,  recompilation  and  re-linking  are 
not  necessary.  In  particular,  a  multi-task^g  application  can  be  developed  on  a  single 
processor  and  then  adapted  for  a  multi-processor  network  simply  by  changing  the 
configuration  file.  The  Flood-Fill  Configurer  allows  creation  of  applications  which  run  on 
any  network  of  processors.  At  load  time,  the  software  analyzes  the  DSP  network  and 
automatically  loads  all  processors  with  copies  of  a  “worker”  task.  It  then  routes  messages 
between  the  workers  and  a  “master”  task  on  the  root  DSP.  Flood-Fill  applications  are 
therefore  topology-independent.  The  communication  between  the  master  and  the  workers 
is  taken  care  of  automatically  by  the  system  software. 

System  debugging  is  of  particular  importance  for  Parallel  DSP  applications.  With  3L 
Parallel  C,  debugging  support  is  available  for  the  analysis  of  multi-tasking  and  multi¬ 
processor  systems.  There  is  also  a  global  I/O  facility  giving  tasks  on  any  processor  the 
ability  to  write  information  to  the  screen  of  a  host  computer. 

Signal  processing  theory,  just  like  other  electronic  engineering  disciplines,  has  made 
extensive  use  of  block  diagrams  to  describe  algorithim  and  systems.  These  diagrams 
usually  show  complex  networks  of  components  all  interconnected  together.  A  signal 
processing  block  diagram  like  the  one  in  Bgure  3-24  describes  a  number  of  independent 
modules  operating  in  parallel,  just  as  in  the  DSP  model.  With  Parallel  C  this  can  be  directly 
implemented  on  a  physical  DSP  network.  Parallel  C  programming  matches  the  structure  of 
DSP  algorithms.  Because  Parallel  C  is  based  a  on  a  standard  ANSI  C  and  does  not  use 
special  language  extensions,  programmers  can  work  in  an  environment  that  they  are  used  to 
and  can  m^e  use  of  the  large  body  of  in-house,  commercial,  and  public  domain  C  code  for 
DSP  algorithms. 


Figure  3-24. 

Diagram  o1  Independent  Module  Operating  in  Parallel. 


4.0  POTENTIAL  POST  APPLICATIONS 

The  successful  completion  of  the  proposed  nonlinear  adaptive  generic  algorithm  will  lead  to 
several  near  term  applications  for  boA  the  military  and  commercial  sectors.  Up  to  now,  the 
construction  of  complex  nonadaptive  systems  has  resulted  in  systems  where  learning  is 
difficult.  The  more  evolutionary  approach  of  genetic  algorithm-based  learning  will  provide 
extensible  systems  that  will  allow  increasingly  powerful  learning  and  complexity.  POC's 
nonlinear  adaptive  GA  will  provide  the  foundations  of  generic  search  and  optimization, 
which  can  be  applied  to  the  following  applications; 
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(1)  Military  apoacations 

•Multisensor  data  fusion 

•Vision  sensing  systems  for  unmarmed  vehicles 

•Threat  assessment  and  decision  module 

•Intelligent  analysis 

•Automatic  ta^et  recognition 

•Communication  routing 

(2)  Commercial  applications 

•Traveling  salesman  problem 
•VLSI  circuit  layout  optimization 

•Communication  network  link  size  optimization  and  optimal  routing 
•Optimization  of  multiprocessor  routing 
•Image  registration 
•Image  feature  searching 

•Highly  sophisticated  security  and  warning  system 

•Pattern  recognition 

•Intelligent  manufacturing 

•Heuristic  fault  diagnosis 

•School  bus  routing 

•Neural  network  training 

•Adaptive  document  clustering 

•Recursive  adt^ttive  filter  design 

•Holographic/diffractive  optic^  element  design 


5.0  CONCLUSIONS  AND  RECOMMENDATIONS 

In  this  Phase  I  program,  POC  successfully  demonstrated  a  universal  high  dimensionality 
(tecision  making  GA,  as  well  as  provided  an  initial  Phase  I  prototype  design.  The  major 
achievements  of  this  program  include  the  determination  of  fiizzy  logic  adaptability  to  GA, 
the  reevaiuation  of  the  mutation,  the  design  of  the  GA  evolvers,  and  a  demonstration  of  the 
feasibility  of  the  proposed  GA  to  high  dimensionality  decision  making. 

In  the  Phase  11  program,  POC  will  finalize  the  GA  DSP  parallel  processor  architecture,  and 
will  focus  on  the  following  tasks: 

1 .  Finalization  of  the  parallel  GA  processor. 

2 .  In^lementation  of  the  Phase  II  prototype. 

3 .  Development  of  the  parallel  programming. 

4 .  Mapping  the  current  GA  program  into  the  parallel  programming. 

5 .  Demonstration  of  image  understanding  using  the  Phase  n  prototype  GA 
decision  maker. 
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void  main (void) 


printf ("WHAT  FUNCTION  DO  YOU  WANT  TO  CHOOSE?\n"); 

printf  ( “\n(l)  Fl(x,y)  =  a*  (x^b  -  cj)*(y''c  -  f)  +  g;\n"); 
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break; 
default : 
break; 
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double  f5(  double  xl,  double  x2) 


